Phase transitions in Paradigm models 
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In this letter we propose two general models for paradigm shift, deterministic propagation model 
(DM) and stochastic propagation model (SM). By defining the order parameter m based on the 
diversity of ideas. A, we study when and how the transition occurs as a cost C in DM or an innovation 
probability a in SM increases. In addition, we also investigate how the propagation processes affect 
on the transition nature. From the analytical calculations and numerical simulations m is shown to 
satisfy the scaling relation ?n = 1 — f{C/N) for DM with the number of agents A'^. In contrast, m 
in SM scales as m = 1 - /(a^TV). 
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Transitions are ubiquitous in human history and in sci- 
entific activities as well as in physical systems. Human 
history of civilizations has qualitatively distinguishable 
periods from stone-age to contemporary civilizations, 
vifhich depend on dominating themes such as philosophy, 
art, technology, etc. In scientific activities such domi- 
nating themes correspond to disparate prevailing ideas 
or concepts such as chaos, complexity, nano, and string 
theory, etc., which are generally called as paradigms. 
Tomas Kuhn said that the successive transition from one 
paradigm to another via revolution is the usual devel- 
opmental pattern of mature science This paradigm 
shift is also very similar to the adoption of a new discrete 
technology level. Examples of such technological levels 
are operating system versions as Linux distributions and 
versions of recently-popular smart phones. 

To describe the appearance and disappearance of those 
paradigms, various models were suggested. But, 

those models cannot describe the paradigm shift. Re- 
cently, an interesting model has been suggested by Born- 
holdt et al. to explain the dynamical properties of 
paradigm shifts [1]. In the Bornholdt model (BM), 
two essential mechanisms for the paradigm shift have 
been suggested. The first is the innovation process in 
which new ideas or paradigms are introduced. The sec- 
ond is the propagation process in which idea of an agent 
possibly spreads to other agents. An important addi- 
tional feature of BM is the memory effect that an agent 
never returns to the idea or the technological level once- 
experienced. By the numerical study on a square lattice, 
Bornhodlt et al. have shown the existence of the ordered 
phase in which a paradigm dominates for the small inno- 
vation probability a [1] . In this ordered phase the pattern 
of the sudden emergence and slow decline of a new global 
paradigm repeats again and again. However it is still an 
open fundamental question when and how this ordered 
phase disappears as a gets larger or approaches to 1. 

Furthermore the propagation of paradigms in BM is 
considered to occur locally and stochastically. In con- 
trast the propagation of ideas is generally successive and 
continuous or has the avalanches as can be seen from the 



spread of ideas through community networks, social net- 
work services and mass communication. In addition, the 
propagation can occur deterministically originated from 
the differences (or gaps) of ideas (or techn olog ical levels) 
between the interacting pairs of agents [9l4lll| . 

To answer the raised questions and to investigate how 
the details of propagation processes affect the paradigm 
shift, we provide two realistic and generalized models 
for paradigm shift, deterministic propagation model 
(DM) and stochastic propagation model (SM). In 
DM the propagation is deterministically controlled by the 
difference of ideas, whereas the propagation is stochasti- 
cally determined in SM. Both models have avalanches of 
propagation. By defining the order parameter, m, based 
on the diversity of ideas. A, we analytically show that the 
disappearance of dominant paradigm can be mapped into 
the traditional order-disorder transition. In DM we show 
that m satisfies the scaling relation m = 1 — f{C/N), 
where C is the propagation cost and N is the total num- 
ber of agents. In contrast, m in SM follows the scal- 
ing relation m — 1 ~ f{a°'N), where a is the innovation 
probability. Here f{x) is a scaling function satisfying 



for a; ^ 1 and f{x) = 1 for x ^ 1. 



of BM 



is also proved to satisfy the same scaling relation as m of 
SM. Thus, in DM the transition threshold C* scales as 
C* ~ N and the transition probability in both SM and 
BM scales as a* ^ N^^^"-. The exponents a and b depend 
both on the models and on the underlying interaction 
topologies. Therefore, from this work, we first provide 
the standard theoretical framework to understand phase 
transitions and related phenomena in paradigm shift. 

To be specific, let's assume that each agent resides on 
a node of a certain graph. At a given time t each agent i 
has a positive integer (t) , which represents a particular 
idea or technological levels. Then at the time t + 1, a 
randomly selected agent i takes the innovation process 
with the probability a or propagates his idea to other 
agents with the probability 1 — a. 

In the innovation process at t, ri{t -f 1) of a randomly- 
chosen agent i takes a discrete jump to be the small- 
est integer which has not been introduced to the whole 



2 



system until the time t. To analyze phase transitions 
from the ordered phase to the disordered phase of the 
paradigm models, we should first understand the model 
with a = 1, which we call the random innova- 
tion model (RIM) [13]. RIM cannot have the global 
paradigm and is always in the disordered phase. In RIM 
one can exactly calculate the diversity A(i), which is 

defined as A{t) = \J {r'^lt)) - {r{t)f, where (r'=(i)) = 

([^j r*^(i)]/A^]) and (...) means the average over realiza- 
tions of models. In RIM, a randomly selected agent i 
at the time t changes his idea ri{t) = t. Let's denote 
p = and q = 1 — 1/N, where p is the selection prob- 
ability of a particular agent. Then the probability Pt{r) 
that an arbitrary agent has the idea r at < is written as 
Pj(r) = pg*"*" for < r < < and Pt{0) = g*. In the limit 
TV ^ oo, we get A(t) = N^/l - e-2*/JV 1 2(t/iV)e-*/^. 
This result has been confirmed by simulation. In the 
steady state (or t — >■ oo), A{t — >■ oo) = A(cxd) = A^. 
A(oo) — N corresponds to the disordered phase for 
a 1 for paradigm models. Thus we take the order 
parameter m for the phase transition of the paradigm 
models in the steady state as to = 1 — A(oo)/A^. Then 
TO = for the disordered phase and m = \ for completely 
ordered phase with A(oo) = 0. 

We now consider two different paradigm models based 
on specifics of propagation process. In DM the prop- 
agation is detcrministically controlled by the cost in 
the following way. A randomly selected agent i prop- 
agates his idea ri{t) to each nearest neighbor j of i, i.e., 
rj{t + l) = Ti (t) at the time t 1 only if (t) - [t) > C. 
Here C is a constant which represents a cost or resistance 
to accept a new paradigm. Then the propagation process 
triggers an avalanche; i.e., if rj{t + 1) is updated, then 
repeat the same propagation process for nearest neigh- 
bors of j. This propagation process is repeated until the 
inequality \rj{t) — ri{t)\ < C is satisfied for all the near- 
est pairs {ij) in the system. In DM, A(oo) depends only 




ts ~ I/a. This result physically means that the system 
is in the steady state if the mean number of innovations, 
at, satisfies at :s> C and the physical properties of the 
steady state depend only on C. 

First we consider DM on the complete graph (CG). 
Each agent on CG is a nearest neighbor of all the other 
agents. Let's think a steady state configuration that ideas 
in the system spread in an integer interval [r^nin , ''max] 
just after an innovation process at t. In the average 
sense r„iax = ctt. If a is small enough, propagation 
processes before the next innovation process drive the 
configuration into that with all > rmax — C , because 
of the propagation process initiated from an agent with 
Ti ~ 7-max- Then the probability Pr^^^ir) that an agent 
has an idea r in such configurations satisfies recursion 
relations Pr^._^^+i[r) = qPr^._,Sr) for rmax — C + 1 < r < 

Tmax and Pr„,,-|-l(''max + I) = P + qPr^^A'^miiK - C + 

1). From the recursion relations we obtain f'r,„ax('") ~ 



-c{r-C) 



pq' 



7(1 -g^) 



and A(oo) = N^/l -1/N- (C/7V)2(qC)/(l - qC)2 
the steady state. In the large N limit, to thus satisfies 



TO = 1 - giC/N) g{x) 



— cosech f — 
2 V2 



(1) 

Eq. (1) agrees very well with the simulation result as 
shown in Fig. ^a). The ordered state of DM on CG 




FIG. 2. (Color online) Scaling plots of m against C/N of 
DM (a) on the complete graph with iV = 8.0 x 10^, (b) on 
a scale-free network (c) on a random network and (d) on a 
square lattice. Curves in the figures show the analytic results 
(1) and (2). 



FIG. 1. (Color online) (a) Scaling plot of A(t) against at of 
DM on a square lattice with = 2^^ and C — 82. Inset: 
plot of A{t) against t. (b) A snapshot of a steady state con- 
figuration of DM on the square lattice with the size 32 x 32. 
Black dots denote agents with a dominant idea rd- White 
dots denotes those with ideas different from rd- 

on C as shown in Fig. [Tfa), because a controls only the 
time ts taken for the system to arrive the steady state as 



has a peculiar physical property. Because Pr„ax('") — 
(l-(nnax-r)/iV)/C ~ 1/C for C < TV, there doesn't ex- 
ist a unique dominant idea, but C ideas are nearly equally 
probable. This peculiar ordered state in the steady state 
comes from combination of the global connectivity of CG. 
In the sense that DM regards ideas with the idea differ- 
ence 6r < C as the same idea, the ordered state on CG 
is physically plausible and understandable. 

In contrast, there exists a unique dominating idea in 
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DM on other graphs with local connectivities for C ^ iV 
as shown in Fig. [Ijb) and Fig. [2j Thus wc want 
to analytically show the existence of the ordered state 
with a dominating idea on the graphs. Arbitrary near- 
est neighbor pair (ij) of agents should satisfy the con- 
dition \ri — rj\ < C after a propagation process. Let 
us think about the configuration with the k-th dominat- 
ing macroscopic idea r^*^^. In the configuration the ideas 
in the system spread in an integer interval [rmiu , r^ax] 
with r^'^'' S [^inin , ''max] • Now we want to show how the 
configuration with (fc-|- l)-th dominating idea r^J^'^^'^ hap- 
pens analytically. As shown in Fig. [Ijb), the nodes (or 
sites) with r'^'^ form a macroscopic percolation cluster 
through the links (or bonds) of the graph and the nodes 
with r 7^ r^*^-* form only isolated microscopic clusters. 
Thus the propagation process which changes the domi- 
nating idea happens the propagations only through the 
macroscopic percolation cluster. Therefore the configu- 
ration with the 7"^*^^^' docs not happen until the idea 
r = r^*"' + C appears in the system. After the idea 
r = r^'^'' + C appears, subsequent propagation processes 
through the macroscopic cluster make the configuration 
with r^J^'^^'^ (= r^'J^'^ + C) appear before the next innova- 
tion process happens if a <C 1/iV. The configurations 
with r^^^^^ = r^p +C +1, rf^ +C + 2 and ... are also 
possible, but the probabilities that these exceptional con- 
figurations happen are at most order of l/N"^ . So we ne- 
glect these exceptional configurations in the subsequent 
calculations. At the time of the paradigm shift the ideas 
in the system spread in the interval [r^'^'*'^'' — C-hl, ''^'^^^'']- 
Then before the next paradigm shift, the configuration of 
the system can evolve to one in which the ideas spread in 
the interval [r^^'^^'^ — C + 1, f^d^^"^ + nj]. nj is the num- 
ber of the innovations which happen before the (fc + 2)-th 
paradigm shift and nj < C . Generally the system in the 
steady state has a configuration with the ideas spread in 
the interval [r^ — C + 1 , + nj] . 

Now we consider the probability P{r) that an agent 
has an idea r in the steady state. Clearly P{r) = for 
r < Td ~ C and r > rd + nj. Furthermore, in the steady 
state P{r) is expected to satisfy P{r) ~ for rd — C< 
r < Td and rd < r < rd + rij , because an idea in the above 
intervals is originated from an innovation process. Thus 
we get Al^ = (1/37V)(C3 + n^) - {1/AN^){C^ + nj - 

2C^n]). From A2(oo) = Al^dni, we get A(cx)) 

as A(oo) = 7VV(5/12)(C/7V)3 + (2/15)(C/7V)4. There- 
fore, m for C < ^ satisfies m = 1 - y/ijVl{C /Nf'^ . 
For C > iV, DM reduces to RIM and to = 0. Thus m 
satisfies the scaling relation 

m=l-J{C/N), (2) 

where f{x) ^ with h = 3/2 for x ^ 1 and f{x) ~ 1 
for x 3> 1. On CG we get the same scaling for to with 



6=1. 

To confirm the scaling relation on the graphs with lo- 
cal connectivity, we study DM by simulations on vari- 
ous graphs. The graphs used in this paper are a static 
scale- free network with the degree exponent 7 = 2.5 [l^, 
and an Erdos-Renyi type random network, and a two- 
dimensional square lattice. To accord with the square 
lattice, the mean degree (fc) of the scale-free and random 
networks is set as {k) ~ 4. The simulation datas of to 
on each graph in Figs. [5] are obtained by averaging over 
at least 1000 realizations. The scaling relation of to with 
6 = 3/2 or Eq. ^ is confirmed by simulations on the 
random network and the square lattice as shown in Figs. 
[2jc) and (d). In contrast, on a scale- free network with 
degree exponent 7 = 2.5, we obtain the scaling relation 
with h = 1.20(3) (Fig. [U^b)), because the scale-free net- 
work has some aspect of global connectivity due to the 
hubs. Thus C at which the phase transition occurs, C*, 
scales as C* ~ TV on arbitrary graph. 

We now analyze SM in which the propagation pro- 
cess occurs stochastically. In a propagation process of 
SM, a randomly selected agent i always tries to propa- 
gate his idea ri{t) to all of nearest neighbors. Explicitly, 
rj{t+ 1) of each j of nearest neighbors to i is made to be 
equal to Tiit) with the probability Ui/N, provided that 
j never experienced ri(t) before. Here rii is the num- 
ber of agents in the system which have the same idea as 
ri (t) . In addition, each agent j whose idea is changed also 
propagates his changed idea to all of his nearest neigh- 
bors in the same manner with the updated probability 
rii/N, because increases as the propagation processes 
proceed. This propagation process is repeated until the 
propagation processes are terminated by the probability 
(1 — rii/N) or all the agents are tried to be propagated. 
Therefore, the propagation process of SM also has the 
avalanche and an idea r can spread to the whole system 
at a given time. Moreover, as we shall see, the scaling 
properties of SM on a graph with local connectivity are 
the same as those of BM [8| . 

TO of SM on CG is analytically calculable, because an 
idea propagates to the whole system by single propaga- 
tion process. Let's consider a configuration that the ideas 
in the system spread in an integer interval [rmin , ''max] 
just before a propagation process. Then by the very 
next propagation process at the time to, an idea rd 
(S ['■min, ''max]) of a randomly selected agent in CG be- 
comes the idea of all agents. Then until next propagation 
process, new ideas, fmax + 1, ''max + 2,... will appear by 
the subsequent innovation processes, because the system 
cannot have ideas experienced before. The mean num- 
ber of innovations after a propagation process until the 
time t + to, is at. Let's think about a situation that all 
the propagation tries between and t + to fail. Then at 
t + io7 the probability PtQ+tir) that an agent has the idea 
r is written as Pto+t{r) = for r < r^, PtQ+t{r) = g"* 
for r = Td and Pto+t{r) = pg"*-(''-''n>-x) foj. ^ > r^^i^y,. 
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Thus we can obtain A{t + to) easily. Since such propaga- 
tion process happens again and again, A(cxd) is written as 

A(cx)) = [ETr=,PiSr)j:ZoSmit + to)]/[j:ZoSit)], 
where S(t) is the probabiUty that no propagation pro- 
cesses happens until t + to and P{6r) of Sr = r^ax — 
rd is the probability that a configuration with G 
{rdji^maK + 1} occurs at the very next innovation pro- 
cess after a propagation process. Now we calculate S{t). 
At t+to the propagation probability is (1 — — q"*)/A^. 
Then S{t) = S{t - 1) [1 - (1 - a)(l - eyip{-at/N))/N] 
in the large N limit. Thus we get S{t) ~ 
exp [-(1 - a)t/N + (1 - a){l - e-"*/^)/a] . P{dr) can 
also be written as P{5r) = (1 - <^)p'^<l'^^ J^Zsr/a ^i^)- 
For at < N, S{t) ~ exp(-i2a(l - a)/2N'^) and A{t + 
to) - iVyT73(at/iV)3/2. Therefore, A{oo) ~ iVa^/* for 
at <t: N and 



m(Q;) = 1 



= 1 -a3/4. 



(3) 



We also confirm Eq. (3) for arbitrary a by use of exact 
expressions of A(t + to), S{t) and P{dr) as shown in 
Fig. [3ja). This result means that there always exists a 
dominating idea or the global paradigm on CG if a < 1. 
On the graphs only with local connectivity, the analytic 
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FIG. 3. (Color online) (a) Plot of m against a of SM (a) on 
the complete graph. The curve represents the analytic result 
m = 1 — o?^'^ . Scaling plots of m of SM against a" A'' on the 
scale-free network (b) , on the random network (c) and on the 
square lattice (d). 

approach as on CG to SM is hardly possible. Instead 
simulations are carried out. A((X)) satisfies the scaling 
ansatz A(c!o) = h{cfiN) very well. As shown in Fig. |3l 
m satisfies the scaling function similar to that of DM as 



m = l-/KA^), 



(4) 



where /(a"iV) = h{a'^N)/N. {a, h} are {2.01(3), 
0.49(2)} on the scale-free network, {1.15(2), 1.05(3)} on 
the random network, {1.10(2), 1.13(2)} on the square lat- 
tice. Thus the phase transition probability a* scales as 



a* ^ N~'^/°' and a* decreases as the global connectivity 
of graphs decreases. Moreover the exponent b increases 
as the global connectivity decreases. The scaling behav- 
ior of SM on the random network is nearly equal to that 
on the square lattice. This result means that the scaling 
behavior hardly depends on dimensionality of the graph, 
but depends on the connectivity. 

We also study m of BM Q. In BM, a randomly se- 
lected agent i tries to propagate his idea to a randomly 
chosen nearest neighbor j with the probability rii/N. 
No further propagation processes are attempted in BM. 
Since the propagation in BM is local, it is difficult to treat 
the model analytically even on CG. Thus BM is studied 
numerically. From the simulations we confirm the same 
scaling behavior m = 1 — f{a"-N) with a = 1.10(2) and 
h = 1.12(3) on any graph, especially on CG. The scal- 
ing behaviors are the same as those of SM on the square 
lattice. Since BM has only local propagation process on 
any graph and the propagation process does not use the 
connectivity of large scale or the global connectivity, even 
on CG, the scaling properties of BM are irrelevant to the 
dimensionality or the connectivity of the graph. SM on 
the square lattice has also only local avalanches, and thus 
the scaling properties of SM on the square lattice are the 
same as those of BM. a* of BM also scales as a* ^ N~'^/°- 
with a ~ 1.1. 
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